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ABSTRACT 

Many  different  reliable  multicast  protocols  have  been 
proposed  and  analyzed  in  the  current  literature.  Since 
satellites  are  naturally  a  broadcast  medium ,  multicast 
communications  have  the  potential  to  greatly  benefit 
from  their  wide-scale  deployment.  The  performance  of 
reliable  multicast  protocols  needs  to  be  studied  and  be¬ 
come  better  understood  over  networks  including  satel¬ 
lite  links.  Most  of  the  analysis  performed  on  these 
protocols  has  dealt  with  bandwidth  usage,  buffer  re¬ 
quirements,  and  processing  delay.  Very  few  studies  ad¬ 
dress  the  transmission  delay  incurred  from  using  reli¬ 
able  multicast  protocols.  Hybrid  error  control  protocols 
have  been  studied  in  terms  of  bandwidth  and  delay. 

The  effects  of  different  estimation  schemes  coupled  with 
autoparity  usage  are  investigated  and  results  are  com¬ 
pared.  Simple  adaptive  mechanisms  used  with  a  local 
recovery  scheme  are  found  to  offer  the  best  overall  re¬ 
sults  in  terms  of  reducing  recovery  latency  and  satellite 
bandwidth  usage. 

INTRODUCTION 

Multicast  communications  are  important  for  hierarchical 
wireless  networks,  such  as  those  used  in  the  military.  En¬ 
suring  reliable  transmission  in  multicast  communication  is 
key  for  military  networks.  Terrestrial,  wireless,  and  mobile 
LANs  supported  by  satellite  provide  great  promise  for  reli¬ 
able  multicast  communication.  This  paper  discusses  the 
combination  of  existing  schemes  required  to  provide  reli¬ 
able  multicast  communications  in  military  networks. 

Many  different  reliable  multicast  protocols  have  been  pro¬ 
posed  and  analyzed  in  the  current  literature.  Examples  of 
such  protocols  include  RMTP[8],  Reliable  Adaptive  Multi¬ 
cast  Protocol  (RAMP)  and  Multicast  File  Transfer 
Protocol  (MFTP).  RAMP  was  intended  for  use  in  collabo¬ 
rative  military  applications  such  as  simulated  war  games. 
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It  attempts  to  reliably  deliver  multicast  data  while  reducing 
latency  [2].  MFTP  [4]  was  designed  for  the  reliable  non- 
real-time  bulk  transfer  of  data.  Since  latency  is  not  a  criti¬ 
cal  design  constraint,  this  protocol  sacrifices  delay  to  gain 
extra  scalability  and  universal  operation  over  different  net¬ 
work  infrastructures  including  satellite  and  other  asymmet¬ 
ric  environments. 

As  seen  from  the  above  examples,  reliable  multicast  proto¬ 
cols  have  been  designed  for  specific  applications  in  specific 
network  environments.  As  reliable  multicast  applications 
begin  to  require  low  latency  operation  over  hybrid  net¬ 
works,  reliable  multicast  protocols  need  to  be  studied  in 
such  networks.  A  natural  starting  point  for  such  studies  is 
the  consideration  of  the  delay  characteristics  over  satellite 
links.  Satellite  links  suffer  from  relatively  high  raw  bit  error 
rates  compared  with  terrestrial  fiber  links  as  well  as  higher 
delay  characteristics.  Therefore,  with  regards  to  reliable 
multicast  applications,  satellite  communication  provides  an 
interesting  set  of  technical  complications  in  which  latency 
becomes  an  important  performance  metric. 

When  considering  latency  of  reliable  multicast  applications 
over  satellite  links,  error  recovery  becomes  a  crucial  issue. 
The  use  of  an  ARQ  scheme  requires  a  feedback  channel 
for  proper  protocol  function.  However,  due  to  the  high  la¬ 
tency  over  satellite  links,  such  schemes  experience  signifi¬ 
cant  throughput  degradation  (e.g.  the  TCP  degradation  ob¬ 
served  over  high  latency  links  [1]).  For  this  reason,  as  well 
as  the  relatively  large  amount  of  feedback  bandwidth 
needed  for  multicast  ARQ  implementations,  one  realizes 
the  importance  of  applying  packet  level  Forward  Error 
Correction  (FEC).  As  previously  demonstrated  in  [5],  hy¬ 
brid  error  control  (HEC)  schemes  that  use  parity  packets 
to  reduce  the  residual  packet  error  probability  and  a  feed¬ 
back  mechanism  to  ensure  reliability  combines  the  advan¬ 
tages  of  both  FEC  and  ARQ  schemes  to  form  a  more  ro- 
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bust  protocol.  Variations  of  these  HEC  protocols  offer  ad¬ 
ditional  potential  benefits.  One  important  variation  uses  lo¬ 
cal  recovery  between  terrestrially  connected  nodes.  This 
variation  limits  the  amount  feedback  to  and  the  number  of 
transmissions  carried  over  the  satellite  link. 

The  remainder  of  the  paper  is  organized  into  four  sections. 
The  next  section  contains  the  descriptions  of  the  generic 
protocols  and  the  two  network  scenarios  considered  in  this 
paper.  These  two  network  scenarios  are  then  studied  and 
their  results  are  presented.  The  paper  concludes  by  sum¬ 
marizing  results  and  presenting  areas  for  future  work 

GENERIC  PROTOCOL  &  NETWORK 
SCENARIOS 

The  generic  HEC  protocol  shown  in  Figure  1  is  similar  to 
the  one  studied  in  [5]  and  is  assumed  throughout  this  paper. 


1) The  sender  sends  a  transmission  group  of  k  data  pack¬ 
ets  and  a  ( autoparity )  £  h  parity  packets  from  the  asso¬ 
ciated  FEC  block 

2) A11  packets  within  the  transmission  group  (TG)  can  be 
recovered  if  there  are  fewer  than  a  missing  packets 
among  the  k  +  a  transmitted  packets. 

3) During  the  initial  transmission  round,  a  receiver  de¬ 
tecting  more  than  a  missing  packets  requests  the  number 
of  parity  packets  required  to  complete  the  TG.  hi  subse¬ 
quent  retransmission  rounds,  the  receiver  requests  the 
number  of  packets  required  to  complete  the  TG. 

4) The  sender  multicasts  the  maximum  number  of  re¬ 
quested  parity  packets  from  all  receivers  until  all  parity 
packets  associated  with  the  TG  have  been  used.  At  that 
time  packets  requiring  retransmission  are  placed  into  a 
new  transmission  group. 

Figure  1:  Generic  HEC  protocol 

The  parity  packets  sent  during  each  retransmission  round 
are  subject  to  the  same  error  probability  as  the  data  pack¬ 
ets.  Lost  parity  results  in  additional  retransmission  rounds 
(step  4:Figure  1)  to  ensure  reliable  delivery.  As  parity  was 
sent  in  the  initial  round,  extra  or  “insurance”  parity  can  also 
be  sent  in  subsequent  retransmission  rounds.  This  concept 
is  referred  to  as  channel  estimation  considerations.  For 
example,  the  amount  of  parity  sent  can  be  calculated  using 
the  maximal  packet  loss  probability  as  measured  during  the 
initial  transmission  round  (step  3:Figure  1)  [3]. 

There  are  two  basic  network  scenarios  that  are  considered 
in  this  paper;  the  unconnected  cluster  scenario  and  the 


connected  cluster  scenario.  A  connectivity  cluster  is  de¬ 
fined  as  set  of  nodes  that  are  virtually  connected  with  each 
other,  hi  each  cluster,  it  is  assumed  that  only  one  node 
called  a  Privileged  Receiver  (PR)  can  communicate  with 
the  satellite.  This  assumption  requires  that  all  other  nodes 
within  a  particular  cluster  be  connected  (either  directly  or 
indirectly)  to  their  corresponding  PR.  These  non-privileged 
nodes  are  known  as  Dependent  Nodes  (DN). 


Figure  2:  Unconnected  Cluster  Scenario 


In  the  unconnected  scenario  as  seen  in  Figure  1 ,  a  source 
sends  multicast  data  over  a  satellite  to  R  connectivity  clus¬ 
ters.  When  considering  reliable  multicast  to  a  group  con¬ 
sisting  of  both  PRs  and  DNs,  a  hierarchical  approach  im¬ 
mediately  presents  itself  as  a  viable  option.  There  have 
been  studies  (e.g.  [6],  [10])  that  indirectly  purport  the  use 
of  hierarchical  multicast  to  reliably  disseminate  data.  As  all 
packets  destined  for  the  connectivity  cluster  must  pass 
through  the  PR,  each  PR  has  the  opportunity  to  buffer 
these  packets.  If  the  PR  correctly  receives  k  packets  (ei¬ 
ther  data  or  parity  packets),  then  it  reconstructs  the  original 
k  data  packets.  If  the  PRs  have  the  ability  to  create  new 
parity  packets,  then  these  parity  packets  combined  with  the 
original  data  packets  can  be  used  to  locally  satisfy  retrans¬ 
mission.  Such  a  scheme  is  similar  to  the  APES  scheme, 
SDBR  proposed  in  [10]. 

Due  to  the  fact  that  PRs  cannot  generate  parity  unless  they 
have  the  k  original  data  packets,  reliable  delivery  can  be 
subdivided  into  two  stages;  1)  delivery  from  source  to  the 
PRs,  and  2)  delivery  from  PRs  to  nodes  within  connectivity 
clusters.  Considering  only  the  first  stage  reduces  the 
problem  to  the  reliable  delivery  of  k  data  packets  to  R  re¬ 
ceivers.  It  is  assumed  that  the  PRs  do  not  forward  packets 
until  they  correctly  receive  and  decode  the  k  data  packets. 
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Upon  the  successful  reception  of  the  k  data  packets,  each 
PR  assumes  the  responsibility  as  the  multicast  source  for 
its  corresponding  connectivity  region.  More  detailed  expla¬ 
nation  of  different  possible  delivery  schemes  are  presented 
in  [9], 

The  connected  scenario  differs  from  the  previous  scenario 
in  that  the  connectivity  clusters  overlap  (see  Figure  3). 
Since  the  connectivity  clusters  are  terrestrially  connected,  a 
multicast  tree  can  be  established  between  the  PRs.  In 
such  a  scheme,  the  source  sends  the  initial  transmission  to 
all  PRs  within  a  specified  multicast  group.  When  a  PR 
detects  a  loss,  it  starts  a  local  retransmission  cycle  by  set¬ 
ting  a  local  retransmission  timer.  If  no  members  in  the  lo¬ 
cal  neighborhood  respond  prior  to  the  timer’s  expiration, 
then  the  PR  begins  a  global  recovery  phase  in  which  it 
transmits  a  global  NAK  over  the  satellite  to  the  source. 

The  PR  enters  another  local  recovery  cycle  if  the  re¬ 
quested  packet  is  not  received.  This  process  is  repeated 
until  the  entire  TG  is  reliably  delivered  to  all  PRs  of  the 
multicast  group. 


Figure  3:  Connected  Cluster  Scenario 


mit  parity  repairs  over  the  entire  tree.  For  a  more  detailed 
explanation  of  the  impact  of  shared  losses  and  temporal 
losses  refer  to  [9]. 

The  results  for  the  infinite  parity  cases  are  presented  in  the 
remainder  of  this  paper.  Using  a  finite  number  of  parity 
packets  negatively  impacts  performance.  The  degree  of 
this  impact  depends  upon  the  actual  number  of  parity  pack¬ 
ets  generated  [9].  In  the  unconnected  scenario,  several 
simplistic  adaptive  mechanisms  are  studied.  In  the  con¬ 
nected  case,  three  local  recovery  schemes  with  different 
local  versus  satellite  transmission  round  ratios  (LxS)  are 
studied.  Only  the  original  source  is  able  to  use  autoparity 
and  channel  estimation  techniques  during  satellite 
(re)transmission  rounds.  All  local  requests  are  fulfilled  us¬ 
ing  distinct  parity  packets. 

RESULTS:  UNCONNECTED  CLUSTER 
SCENARIO 

A  large  amount  of  analytical  work  was  completed  in  [9]. 

In  addition  to  this  work,  simulations  were  created  so  that 
results  could  be  obtained  in  the  cases  where  analytical  re¬ 
sults  were  not  tractable  in  addition  to  verifying  the  analyti¬ 
cal  work.  The  number  of  simulation  trials  used  to  create 
each  data  point  were  no  less  than  1,000.  Although  not  ex¬ 
tensively  studied,  it  was  found  that  increasing  the  number 
of  trials  to  10,000  resulted  in  no  appreciable  difference  in 
results.  Simulations  of  were  created  for  each  of  the  four 
possible  variations  on  the  unconnected  connectivity  cluster 
scenario;  infinite  parity  without  channel  estimation  consid¬ 
erations,  infinite  parity  with  channel  estimation  considera¬ 
tions,  finite  parity  without  channel  estimation  considera¬ 
tions,  finite  parity  without  channel  estimation  considera¬ 
tions.  The  finite  parity  variations  are  not  discussed  in  this 
paper. 


Now,  the  assumptions  concerning  the  packet  error  prob¬ 
ability  at  receivers  in  the  multicast  group  need  to  be  con¬ 
sidered.  Packet  errors  (packet  losses)  are  assumed  to  be 
both  spatially  and  temporally  independent  at  the  receivers. 
Independent  losses  uniformly  scatter  the  losses  amongst 
the  receivers  in  the  group;  whereas  shared  losses  have  the 
potential  to  concentrate  losses  in  particular  areas  of  the 
tree.  In  reality,  the  errors  occurring  at  receivers  depend 
upon  many  different  factors.  When  using  tree  structures,  a 
loss  within  the  tree  will  be  shared  by  more  than  one  re¬ 
ceiver  (i.e.  shared  loss).  Multicast  trees'  shared  losses  are 
modeled  well  by  a  full  binary  tree  (FBT)  [7].  Regardless 
of  the  locality  of  the  losses,  the  source  still  needs  to  trans¬ 


In  the  unconnected  scenario,  the  use  of  autoparity  was  ex¬ 
amined  and  found  to  reduce  the  number  of  transmission 
rounds  (as  shown  in  Figures  4  and  5).  This  reduction 
comes  at  the  cost  of  additional  bandwidth  usage  for  low 
packet  loss  probabilities. 
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Figure  4:  E[Transmission  Rounds]  for  a=l 


However,  as  the  packet  loss  probability  increases,  the  in¬ 
trinsic  overhead  cost  associated  with  autoparity  is  reduced 
(see  Figure  6).  Such  a  reduction  suggests  that  intelligent 
use  of  autoparity  can  help  to  lower  the  delay  without  dras¬ 
tically  increasing  bandwidth  usage.  Secondly,  the  maximal 
packet  loss  probability,  channel  estimation  technique  [3] 
was  investigated  using  different  levels  of  autoparity.  It  was 
found  that  the  number  of  required  retransmission  rounds 
was  reduced  to  approximately  two  at  the  cost  of  a  sub¬ 
stantial  increase  in  the  number  of  packets. 


Figure  5:  E[Transmission  Rounds]  for  a=3 


Prpacket  error! 


— •— R=1  R=25  — *—  R=50  — x—  R=75  — R=100 

Figure  6:  Ratio  of  expected  values 


Before  studying  the  connected  scenario  with  local  recovery 
schemes,  simplistic  adaptive  mechanisms  where  the  parity 
provided  during  each  transmission  is  adjusted  based  upon 
observed  packet  loss  statistics  are  investigated.  One  possi¬ 
ble  scheme  dynamically  changes  the  amount  of  autoparity 
based  upon  a  moving  average  of  the  packet  loss  probability 
observation.  The  performance  of  this  dynamic  autoparity 
technique  does  not  outperform  the  a=3  case  over  the  entire 
range  of  packet  loss  probabilities.  However,  this  scheme  is 
more  bandwidth  efficient  at  lower  packet  loss  probabilities 
and  does  not  drastically  increase  the  expected  number  of 
retransmission  rounds.  Another  possible  improvement  uses 
a  moving  average  estimation  of  the  packet  loss  probability 
to  calculate  the  number  of  “insurance”  packets  that  are 
sent  during  subsequent  retransmission  rounds.  This  moving 
average  scheme  apply  to  insurance  packets  does  not  per¬ 
form  as  well  as  the  maximal  channel  estimation  technique 
at  higher  packet  loss  probabilities.  [9] 

These  two  techniques  can  be  combined  into  one  protocol. 
When  comparing  the  dynamic  autoparity  case  protocols 
that  use  and  do  not  use  the  moving  average  channel  esti¬ 
mation  technique,  one  notices  that  the  combination  of  these 
two  scheme  results  in  a  decrease  in  the  number  of  re¬ 
transmission  rounds  (see  Figure  7  and  Figure  8).  In  both  of 
these  figures  the  TG  size,  k,  equals  20.  This  performance 
improvement  is  realized  with  a  negligible  increase  in  the 
expected  number  of  transmitted  packets  [9]. 
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Figure  7:  E[Transmission  Rounds]  for  dynamic  autoparity 


Figure  8:  E[Transmission  Rounds]  for  dynamic  autoparity 
with  the  moving  average  channel  estimation  technique 

RESULTS:  CONNECTED  CLUSTER  SCENARIO 

For  the  connected  cluster  scenario,  there  are  several  alter¬ 
native  solutions  that  could  limit  the  expected  number  of 
satellite  rounds.  Specifically,  local  network  usage  was  ex¬ 
amined  and  found  to  reduce  both  the  expected  number  of 
satellite  transmissions  and  the  expected  number  of  satellite 
transmission  rounds.  The  first  local  recovery  mechanism 
studied  alternated  between  one  global  and  one  local  trans¬ 
mission  round.  This  scheme  was  examined  in  both  the  ab¬ 
sence  of  channel  estimation  techniques  and  in  their  pres¬ 
ence.  Without  channel  estimation,  the  local  recovery 
schemes  used  fewer  satellite  rounds  and  transmitted  fewer 
satellite  packets  than  their  non-local  recovery  counterparts. 
In  the  presence  of  the  maximal  channel  estimation  tech¬ 
nique,  the  lxl  local  recovery  scheme  did  not  offer  sub¬ 
stantial  gains  over  the  non-local  recovery  case.  When  in¬ 
creasing  the  LxS  ratio  (e.g.  from  lxl  to  3x1),  the  perform¬ 
ance  gains  depended  upon  the  number  of  PRs  within  the 


terrestrial  multicast  tree  as  well  as  the  number  of  DNs 
within  each  connectivity  cluster.  For  smaller  connectivity 
clusters,  there  are  fewer  potential  DNs  to  correctly  receive 
the  entire  TG.  For  larger  ones,  there  are  more  local 
subtrees  and  therefore  a  greater  chance  that  additional 
satellite  rounds  are  required.  More  in  depth  discussion  and 
accompanying  graphs  can  be  found  in  [9]. 

LxS  local  recovery  schemes  coupled  with  dynamic  auto¬ 
parity  and  the  moving  average  channel  estimation  scheme 
offer  noticeable  performance  gains  over  their  non-local 
counterparts.  In  terms  of  both  bandwidth  and  delay,  these 
combination  LxS  local  recovery  schemes  offer  the  lowest 
average  number  of  retransmission  rounds  using  the  fewest 
number  of  packets.  In  fact,  using  a  sufficiently  high  LxS 
enables  the  protocol  to  decrease  the  number  of  satellite 
transmission  rounds  to  approximately  less  1.15  for  multicast 
groups  larger  than  four  receivers  [9].  For  large  groups,  this 
is  a  significant  improvement  over  the  previously  discussed 
results. 

CONCLUSIONS  &  FUTURE  WORK 

Although  most  of  the  results  obtained  in  this  paper  were  for 
the  expected  number  of  satellite  transmission  rounds,  this 
metric  gives  a  good  feel  for  the  amount  of  time  the  protocol 
requires  to  reliably  deliver  a  TG.  By  using  relatively  simple 
adaptive  techniques,  the  “combination”  protocols  were 
found  to  decrease  the  expected  number  of  rounds.  In  the 
connected  scenario  case,  performance  improvements  come 
at  the  cost  of  local  transmission  rounds  and  therefore 
places  a  larger  load  on  the  local  networks.  Even  though 
this  study  demonstrated  the  performance  enhancements 
achieved  through  using  relatively  simple  modifications  to 
existing  reliable  multicast  protocols,  further  efforts  should 
be  applied  to  the  following  areas.  More  realistic  local 
packet  loss  probabilities  that  include  correlated  losses  need 
to  be  incorporated  into  study.  The  preceding  study  as¬ 
sumed  that  all  receivers  have  the  same  processing  power. 

If  they  do  not  have  similar  capabilities,  then  the  schemes 
suggested  in  this  paper  need  to  be  adapted  to  account  for 
this  additional  design  constraint.  The  local  recovery 
scheme  in  which  both  local  parity  packets  and  original  data 
packets  are  transmitted  as  repairs  can  be  studied.  Per¬ 
haps,  the  most  promising  area  of  further  research  lies  in 
obtaining  and  studying  satellite  packet  loss  statistics  and 
developing  advanced  estimation  schemes. 
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